Appl.No. 10/072,820 

Resp. dated February 16, 2005 

Supplemental Response 



Listing of Claims: 

1 . (Previously Presented) A method for the processing of test results of one or more tests 
taken by a plurality of test-takers, the method comprising: 

(a) obtaining, with respect to each such test, the test itself, said test having a plurality of 

items; 

(b) obtaining item responses of test-takers taking such test; 

(c) identifying a skill set comprising one or more skills for said test, at least one of said skills 
being necessary for a correct response for each item of the plurality of items; 

(d) assessing the extent to which each item on the test assesses one or more of the skills 
identified in (c) ; and 

(e) calculating a score for each test-taker's performance in each of said skill skills. 

2. (Previously Presented) A method in accordance with claim 1, further comprising 
calculating the scores of a group within skills, said group defined as a plurality of test-takers. 

3. (Previously Presented) A method in accordance with claim 2, further comprising 
generating evaluation and formative statements for individual test-takers and groups. 

4. (Previously Presented) The method in accordance with claim 3, further comprising 
organizing instructional material based on the content of the test. 

5. (Previously Presented) The method in accordance with claim 4, further comprising 
displaying test results and instructional material to individuals. 
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6. (Previously Presented) A method for generating skill by skill scores for individual test- 
takers of a test, the method comprising: 

(a) generating multiple potential skill sets, whereby each skill set includes one or more skills 
tested on the test; 

(b) producing an item skill coding matrix for the test with respect to each of the skill sets, 
wherein each test item is assigned to a single skill of said skill set; 

(c) implementing an iterative procedure in which pedagogical experts and statistical experts 
engage in a joint selection process whereby a single skill set and a single item skill coding matrix 
are selected from among the aforementioned skill sets and corresponding coding matrices; and 

(d) applying the selected skill set and the selected item skill coding matrix to each test-taker's 
set of item responses in order to determine skill by skill scores for each test-taker. 

7. (Previously Presented) The method of claim 6 wherein the item skill coding matrices are 
non-binary and reflect assignments of each item to one or more skills in proportion to the extent to 
which the item is deemed tested by said skills. 

8. (Previously Presented) A method for generating evaluative or formative statements for 
individual test-takers with respect to skills assessed on a test, the method comprising: 

(a) obtaining as inputs for a first probabilistic function the test-takers' overall scores on the 
test as a whole; 

(b) obtaining as inputs for the first function a set of skills assessed on the test; 

(c) obtaining as inputs for first function the test-takers' skill-by-skill scores on each skill 
assessed on the test; 

(d) obtaining as inputs for the first function a score-to-statement mapping between (i) 
individual test-takers' possible scores on the test as a whole, and (ii) a set of overall evaluative or 
formative statements used to describe individual test-takers' overall performance on the test as a 
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whole; and 

(e) employing the first function to select, based on the inputs obtained in (a) through (d), one 
of the overall evaluative or formative statements to describe each test-taker's performance on each 
skill assessed on the test. 

9. (Previously Presented) The method according to claim 8 comprising: 

(f) obtaining as inputs for a second function the overall evaluative or formative statements 
describing each test-taker's performance on each skill assessed on the test, resulting from the first 
function; 

(g) obtaining as inputs for the second function a statement-to-statement mapping between 
(i) a set of overall evaluative or formative statements used to describe the individual test-takers' 
possible scores on the test as a whole, and (ii) a set of skill-appropriate evaluative or formative 
statements; and 

(h) employing the second function to select, based on the inputs obtained in (f) and (g), a 
skill-appropriate evaluative or formative statement to each test-taker's performance on each skill 
assessed on the test. 

10. (Previously Presented) A method for calculating individual test-takers' growth potential 
in particular skills assessed on a test, the method comprising: 

(a) obtaining as inputs for a first function skill-by-skill scores of individual test-takers on 
each of the skills assessed on the test; 

(b) obtaining as inputs for the first function benchmark skill scores of a larger group of test- 
takers on each of the skills evaluated by the test, wherein the larger group includes said individual 
test-takers; and 

(c) employing the first function to calculate, based on said inputs, a numerical score 
reflecting each individual test-taker's growth potential in each skill, wherein the first function is a 
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non-increasing function of the inputs referred to in (a) and a non-decreasing function of the inputs 
referred to in (b). 

11. (Previously Presented) The method according to claim 10 comprising: 

(d) obtaining as additional inputs for the first function a quantitative calculation of the extent 
to which each skill was tested on the test, wherein the first function is a non-decreasing function of 
said additional inputs. 

12. (Previously Presented) The method according to claim 10 comprising: 

(e) obtaining as inputs for a second function the numerical scores calculated by the first 
function; 

(f) obtaining as inputs for the second function a score-to-statement mapping between (i) the 
calculated numerical scores and (ii) a set of skill-appropriate evaluative or formative statements; and 

(g) employing the second function to assign, based on said inputs, a skill-appropriate 
evaluative or formative statement to each test-taker's performance on each tested skill based on the 
test-taker's growth potential in said skill. 

13. (Previously Presented) A method for assigning an appropriate evaluative or formative 
statement in a skill to a group of test-takers based on their results on a test, the method comprising: 

(a) with respect to a single skill, obtaining as inputs all assignments of evaluative or 
formative statements for individual test-takers based on their results on the test; 

(b) with respect to that skill, calculating a number of times each evaluative or formative 
statement was assigned to individual test-takers in the group; and 

(c) with respect to that skill, assigning to the group the evaluative or formative statement 
assigned to the greatest number of test-takers in the group. 
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14. (Previously Presented) A method for choosing an instructional approach in a skill 
appropriate for a group of test-takers based on results of a test, the method comprising: 

(a) identifying a set of potential instructional approaches in the skill; 

(b) estimating the utility of each identified instructional approach with respect to each 
individual test-taker, based on that test-taker's performance in the skill on the test; and 

(c) determining which of the potential instructional approaches in the skill maximizes an 
aggregated utility of all individual test-takers in the group. 

1 5 . (Previously Presented) A method for displaying test-takers' results on a test administered 
during the prior instructional timeframe, the method comprising: 

(a) obtaining test-takers' skill-by-skill scores or evaluative or formative statements with 
respect to a test that (i) is administered during a given instructional timeframe and (ii) assesses a 
subject in which the class groupings of test-takers for purposes of instruction varies between that 
instructional timeframe and a next analogous instructional timeframe; and 

(b) displaying skill-by-skill scores or evaluative or formative statements with respect to those 
test-takers, wherein displays of such test-takers are organized around class groupings of a next 
analogous instructional timeframe. 

16. (Previously Presented) A method for displaying test results, the method comprising: 
(a) providing a printed report that includes test results and related information for one or 

more tests and that includes one or more access codes to enable a recipient to access secure accounts 
on a computer network that contain additional test results and related information; and 

(c) distributing the report to an appropriate recipient. 

17. (Previously Presented) The method according to claim 16 comprising: 

(d) providing access to the secure accounts via the computer network in response to the 
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recipient entering the one or more access codes. 

18. (Previously Presented) A method for providing results of a group of test-takers with 
respect to multiple skills assessed on a test, the method comprising: 

(a) displaying the results of the group of test-takers in multiple tested skills, such that a single 
display includes names of tested skills and corresponding scores or evaluative or formative 
statements reflecting the group's results in each skill; 

(b) employing an electronic interface to enable a viewer to select a tested skill from the 
display and thereby view another display of the results of the group of test-takers in a single skill; 
and 

(c) displaying the results of the group of test-takers in the single skill, wherein the latter- 
mentioned display includes a list of test-takers' names and a presentation of the scores or the 
evaluative or formative statements applying to each individual test-taker in the skill. 

19. (Previously Presented) The method according to claim 18 wherein the display referred 
to in (c) includes a presentation of individual test-takers' names, shown in subgroups corresponding 
to the evaluative or formative statement appropriate to each subgroup. 

20. (Previously Presented) The method according to claim 18 comprising: 

(d) employing an electronic interface to enable the viewer to select another tested skill and 
thereby view a display of the results of the group of test-takers in a single skill, such that the latter- 
mentioned display includes a presentation of the scores or the evaluative or formative statements 
applying to each individual test-taker in that skill. 

21. (Previously Presented) A method for providing results of one or more test-takers with 
respect to multiple skills assessed on a test, together with skill-specific instructional materials 
appropriate to that group of test-takers, the method comprising: 
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(a) displaying the results of one or more test-takers in multiple tested skills, such that a single 
display includes names of tested skills and corresponding scores or evaluative or formative 
statements reflecting the test-takers' aggregate results in each skill; and 

(b) employing an electronic interface to enable a viewer of the display to select a tested skill 
and thereby view instructional materials relevant to that skill. 

22. (Previously Presented) The method according to claim 21 wherein the instructional 
materials include instructional materials of a difficulty level appropriate to the test-takers based on 
their performance on the test. 

23. (Previously Presented) A method for providing results of one or more test-takers with 
respect to skills assessed on one or more multi-skill tests, enabling the administration of skill specific 
assessments, and displaying the results thereof, the method comprising: 

(a) displaying the results of one or more test-takers in multiple tested skills on a single test, 
such that a single display includes names of the tested skills and, for each skill, corresponding scores 
or evaluative or formative statements reflecting the test-takers' aggregate results in that skill; 

(b) employing an electronic interface to enable a viewer of the display to select a tested skill 
and thereby view one or more assessments specific to that skill; 

(c) employing an electronic interface to enable the viewer to choose an assessment specific 
to the selected skill; 

(d) employing an electronic interface to enable the viewer to distribute, to one or more of the 
test-takers, the chosen assessment; 

(e) employing an electronic interface to enable the viewer to collect results of the chosen 
assessment specific to the selected skill, for one or more of the same test-takers; and 

(f) employing an electronic interface to enable the viewer, from a single display, to choose 
to view (i) displays of test-takers' results in a given skill based on one or more multi-skill tests or 
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(ii) displays of test-takers' results on one or more assessments specific to the selected skill, wherein 
each of the displays includes a list of test-takers' names and a presentation of the scores or the 
evaluative or formative statements applying to each individual test-taker in that skill. 

24. (Previously presented) A method for providing results of a group of test-takers with 
respect to multiple skills assessed on a test, the method comprising: 

(a) displaying overall results of the group of test-takers on the test, such that a single display 
includes multiple test-takers and corresponding overall scores in the test for each individual test- 
taker; 

(b) employing an electronic interface to enable a viewer to select an individual test-taker and 
thereby view a display of that test-taker's results in multiple tested skills; and 

(c) displaying an individual test-taker's results in multiple tested skills, wherein the display 
includes multiple tested skills with corresponding scores reflecting the test-taker's performance in 
each tested skill. 

25. (Previously Presented) The method according to claim 24 wherein the display referred 
to in (c) includes multiple tested skills with corresponding evaluative or formative statements 
reflecting the test-taker's performance in each of the tested skills. 

26. (Previously Presented) A system for processing and displaying test results of one or more 
tests taken by a plurality of test-takers comprising: 

a data intake module to: 

(a) obtain, with respect to each such test, the test itself, said test having a plurality of items; 

and 

(b) obtain item responses of test-takers taking such test; and 

a computer coupled to the data intake module wherein the computer is adapted to: 
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(c) determine appropriate skill categories necessary for a correct response for each of said 

items; 

(d) assess the extent to which each item on the test assesses one or more of the skills 
determined in (c) ; and 

(e) calculate a score for each student's performance in each of said skill categories. 

27. (Previously Presented) The system of claim 26 wherein the computer is adapted to 
calculate the scores of a group within skill categories, said group defined as a plurality of test-takers. 

28. (Previously Presented) The system of claim 27 wherein the computer is adapted to 
generate evaluation and formative statements for individual test-takers and groups. 

29. (Previously Presented) The system of claim 28 wherein the computer is adapted to 
organize instructional material based on the content of the test. 

30. (Previously Presented) The system of claim 29 comprising a display coupled to the 
computer to display test results and instructional material to individuals. 

31. (Previously Presented) A system for generating evaluative or formative statements for 
individual test-takers with respect to skills assessed on a test, the system comprising: 

a data intake module to: 

(a) obtain as inputs for a first probabilistic function the test-takers' overall scores on the test 
as a whole; 

(b) obtain as inputs for the first function a set of skills assessed on the test; (c)obtain as inputs 
for first function the test-takers' skill-by-skill scores on each skill assessed on the test; and 

(d) obtain as inputs for the first function a score-to-statement mapping between (i) individual 
test-takers' possible scores on the test as a whole, and (ii) a set of overall evaluative or formative 
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statements used to describe individual test-takers' overall performance on the test as a whole; and 
a computer coupled to the data intake module wherein the computer is adapted to: 

(e) employ the first function to select, based on the inputs obtained in (a) through (d), one 
of the overall evaluative or formative statements to describe each test-taker's performance on each 
skill assessed on the test. 

32. (Previously Presented) The system according to claim 3 1 wherein the data intake module 
is adapted to: 

(f) obtain as inputs for a second function the overall evaluative or formative statements 
describing each test-taker's performance on each skill assessed on the test, resulting from the first 
function; and 

(g) obtain as inputs for the second function a statement-to-statement mapping between (i) 
a set of overall evaluative or formative statements used to describe the individual test-takers' 
possible scores on the test as a whole, and (ii) a set of skill-appropriate evaluative or formative 
statements; and 

wherein the computer is adapted to: 

(h) employ the second function to select, based on the inputs obtained in (f) and (g), a skill- 
appropriate evaluative or formative statement to each test-taker' s performance on each skill assessed 
on the test. 

33. (Previously Presented) A system for calculating individual test-takers' growth potential 
in particular skills assessed on a test comprising: 

a data intake module to: 

(a) obtain as inputs for a first function skill-by-skill scores of individual test-takers on each 
of the skills assessed on the test; and 
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(b) obtain as inputs for the first function benchmark skill scores of a larger group of test- 
takers on each of the skills evaluated by the test, wherein the larger group includes said individual 
test-takers; and 

a computer coupled to the data intake module wherein the computer is adapted to: 

(c) employ the first function to calculate, based on said inputs, a numerical score reflecting 
each individual test-taker's growth potential in each skill, wherein the first function is a non- 
increasing function of the inputs referred to in (a) and a non-decreasing function of the inputs 
referred to in (b). 

34. (Previously Presented) The system according to claim 33 wherein the data intake module 
is adapted to: 

(d) obtain as additional inputs for the first function a quantitative calculation of the extent 
to which each skill was tested on the test, wherein the first function is a non-decreasing function of 
said additional inputs. 

35. (Previously Presented) The system according to claim 33 wherein the data intake module 
is adapted to: 

(e) obtain as inputs for a second function the numerical scores calculated by the first 
function; and 

(f) obtain as inputs for the second function a score-to-statement mapping between (i) the 
calculated numerical scores and (ii) a set of skill-appropriate evaluative or formative statements; and 

wherein the computer is adapted to: 

(g) employ the second function to assign, based on said inputs, a skill-appropriate evaluative 
or formative statement to each test-taker's performance on each tested skill based on the test-taker's 
growth potential in said skill. 
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36. (Previously Presented) A system for assigning an appropriate evaluative or formative 
statement in a skill to a group of test-takers based on their results on a test, the system comprising: 

a data intake module to: 

(a) with respect to a single skill, obtain as inputs all assignments of evaluative or formative 
statements for individual test-takers based on their results on the test; and 

a computer coupled to the data intake module wherein the computer is adapted to: 

(b) with respect to that skill, calculate a number of times each evaluative or formative 
statement was assigned to individual test-takers in the group; and 

(c) with respect to that skill, assign to the group the evaluative or formative statement 
assigned to the greatest number of test-takers in the group. 

37. (Previously Presented) A system for choosing an instructional approach in a skill 
appropriate for a group of test-takers based on results of a test, the system comprising: 

a computer adapted to: 

(a) identify a set of potential instructional approaches in the skill; 

(b) estimate the utility of each identified instructional approach with respect to each 
individual test-taker, based on that test-taker's performance in the skill on the test; and 

(c) determine which of the potential instructional approaches in the skill maximizes an 
aggregated utility of all individual test-takers in the group. 

38. (Previously Presented) A system for displaying test-takers' results on a test administered 
during the prior instructional timeframe, the system comprising: 

a data intake module to: 

(a) obtain test-takers' skill-by-skill scores or evaluative or formative statements with respect 
to a test that (i) is administered during a given instructional timeframe and (ii) assesses a subject in 
which the class groupings of test-takers for purposes of instruction varies between that instructional 
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timeframe and a next analogous instructional timeframe; 
a display; and 

a computer coupled to the display and the data intake module, wherein the computer is 
adapted to: 

(b) cause to be displayed on the display skill-by-skill scores or evaluative or formative 
statements with respect to those test-takers, wherein displays of such test-takers are organized around 
class groupings of a next analogous instructional timeframe. 

39. (Previously Presented) A system for providing results of a group of test-takers with 
respect to multiple skills assessed on a test, the system comprising: 

a display to display the results of the group of test-takers in multiple tested skills, such that 
a single screen on the display includes names of tested skills and corresponding scores or evaluative 
or formative statements reflecting the group's results in each skill; and 

an electronic interface to enable a viewer to select a tested skill from the display and thereby 
view another display of the results of the group of test-takers in a single skill, 

wherein, in response to the viewer's selection, the display displays the results of the group 
of test-takers in the single skill together with a list of test-takers' names and a presentation of the 
scores or the evaluative or formative statements applying to each individual test-taker in the skill. 

40. (Previously Presented) The system according to claim 39 wherein, in response to the 
viewer's selection, the display also includes a presentation of individual test-takers' names, shown 
in subgroups corresponding to the evaluative or formative statement appropriate to each subgroup. 
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41 . (Previously Presented) The system according to claim 39 wherein the electronic interface 
enables the viewer to select another tested skill and thereby view a display of the results of the group 
of test-takers in a single skill together with a presentation of the scores or the evaluative or formative 
statements applying to each individual test-taker in that skill. 

42. (Previously Presented) A system for providing results of one or more test-takers with 
respect to multiple skills assessed on a test, together with skill-specific instructional materials 
appropriate to that group of test-takers, the system comprising: 

a display to display the results of one or more test-takers in multiple tested skills, such that 
a single screen on the display includes names of tested skills and corresponding scores or evaluative 
or formative statements reflecting the test-takers' aggregate results in each skill; and 

an electronic interface to enable a viewer of the display to select a tested skill and thereby 
view instructional materials relevant to that skill. 

43. (Previously Presented) The system according to claim 42 wherein the instructional 
materials include instructional materials of a difficulty level appropriate to the test-takers based on 
their performance on the test. 

44. (Previously Presented) A system for providing results of one or more test-takers with 
respect to skills assessed on one or more multi-skill tests, enabling the administration of skill specific 
assessments, and displaying the results thereof, the system comprising: 

a display to display the results of one or more test-takers in multiple tested skills on a single 
test, such that a single screen on the display includes names of the tested skills and, for each skill, 
corresponding scores or evaluative or formative statements reflecting the test-takers' aggregate 
results in that skill; and 

an electronic interface to enable a viewer of the display to: 
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select a tested skill and thereby view one or more assessments specific to that skill; 
choose an assessment specific to the selected skill; 
distribute, to one or more of the test-takers, the chosen assessment; 
collect results of the chosen assessment specific to the selected skill, for one or more of the 
same test-takers; and 

choose, from a single screen on the display, to view (i) displays of test-takers' results in a 
given skill based on one or more multi-skill tests or (ii) displays of test-takers' results on one or more 
assessments specific to the selected skill, wherein each of the displays includes a list of test-takers' 
names and a presentation of the scores or the evaluative or formative statements applying to each 
individual test-taker in that skill. 

45. (Previously Presented) A system for providing results of a group of test-takers with 
respect to multiple skills assessed on a test, the system comprising: 

a display to display overall results of the group of test-takers on the test, such that a single 
display includes multiple test-takers and corresponding overall scores in the test for each individual 
test-taker; and 

an electronic interface to enable a viewer to select an individual test-taker and thereby view 
a display of that test-taker's results in multiple tested skills; 

wherein, in response to the viewer's selection, the display displays an individual test-taker's 
results in multiple tested skills, wherein the display includes multiple tested skills with 
corresponding scores reflecting the test-taker's performance in each tested skill. 

46. (Previously Presented) The system according to claim 45 wherein, in response to the 
viewer's selection, the display displays multiple tested skills with corresponding evaluative or 
formative statements reflecting the test-taker's performance in each of the tested skills. 
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47. (Previously Presented) An article for processing and displaying test results of one or more 
tests taken by a plurality of test-takers, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

(a) obtain, with respect to each such test, the test itself, said test having a plurality of items; 

and 

(b) obtain item responses of test-takers taking such test; 

(c) determine appropriate skill categories necessary for a correct response for each of said 

items; 

(d) assess the extent to which each item on the test assesses one or more of the skills 
determined in (c) ; and 

(e) calculate a score for each student's performance in each of said skill categories. 

48. (Previously Presented) The article of claim 47 wherein the medium includes instructions 
for causing the computer system to calculate the scores of a group within skill categories, said group 
defined as a plurality of test-takers. 

49. (Previously Presented) The article of claim 48 wherein the medium includes instructions 
for causing the computer system to generate evaluation and formative statements for individual test- 
takers and groups. 

50. (Previously Presented) The article of claim 49 wherein the medium includes instructions 
to cause the computer system to organize instructional material based on the content of the test. 

5 1 . (Previously Presented) The article of claim 50 wherein the medium includes instructions 
to cause the computer system to display test results and instructional material to individuals. 
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52. (Previously presented) An article for generating evaluative or formative statements for 
individual test-takers with respect to skills assessed on a test, the article comprising a computer- 
readable medium storing computer-executable instructions that, when applied to a computer system, 
cause the computer system to: 

(a) obtain as inputs for a first probabilistic function the test-takers' overall scores on the test 
as a whole; 

(b) obtain as inputs for the first function a set of skills assessed on the test; 

(c) obtain as inputs for first function the test-takers' skill-by-skill scores on each skill 
assessed on the test; and 

(d) obtain as inputs for the first function a score-to-statement mapping between (i) individual 
test-takers' possible scores on the test as a whole, and (ii) a set of overall evaluative or formative 
statements used to describe individual test-takers' overall performance on the test as a whole; and 

(e) employ the first function to select, based on the inputs obtained in (a) through (d), one 
of the overall evaluative or formative statements to describe each test-taker's performance on each 
skill assessed on the test. 

53. (Previously Presented) The article according to claim 52 wherein the medium includes 
instructions for causing the computer system to: 

(f) obtain as inputs for a second function the overall evaluative or formative statements 
describing each test-taker's performance on each skill assessed on the test, resulting from the first 
function; 

(g) obtain as inputs for the second function a statement-to-statement mapping between (i) 
a set of overall evaluative or formative statements used to describe the individual test-takers' 
possible scores on the test as a whole, and (ii) a set of skill-appropriate evaluative or formative 
statements; and 

(h) employ the second function to select, based on the inputs obtained in (f) and (g), a skill- 
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appropriate evaluative or formative statement to each test-taker's performance on each skill assessed 
on the test. 

54. (Previously Presented) An article for calculating individual test-takers' growth potential 
in particular skills assessed on a test, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

(a) obtain as inputs for a first function skill-by-skill scores of individual test-takers on each 
of the skills assessed on the test; and 

(b) obtain as inputs for the first function benchmark skill scores of a larger group of test- 
takers on each of the skills evaluated by the test, wherein the larger group includes said individual 
test-takers; and 

(c) employ the first function to calculate, based on said inputs, a numerical score reflecting 
each individual test-taker's growth potential in each skill, wherein the first function is a non- 
increasing function of the inputs referred to in (a) and a non-decreasing function of the inputs 
referred to in (b). 

55. (Previously Presented) The article according to claim 54 wherein the medium includes 
instructions to cause the computer system to: 

(d) obtain as additional inputs for the first function a quantitative calculation of the extent 
to which each skill was tested on the test, wherein the first function is a non-decreasing function of 
said additional inputs. 

56. (Previously Presented) The article according to claim 54 wherein the medium includes 
instructions to cause the computer system to: 

(e) obtain as inputs for a second function the numerical scores calculated by the first 
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function; 

(f) obtain as inputs for the second function a score-to-statement mapping between (i) the 
calculated numerical scores and (ii) a set of skill-appropriate evaluative or formative statements; and 

(g) employ the second function to assign, based on said inputs, a skill-appropriate evaluative 
or formative statement to each test-taker's performance on each tested skill based on the test-taker's 
growth potential in said skill 

57. (Previously Presented) An article for assigning an appropriate evaluative or formative 
statement in a skill to a group of test-takers based on their results on a test, the article comprising a 
computer-readable medium storing computer-executable instructions that, when applied to a 
computer system, cause the computer system to: 

(a) with respect to a single skill, obtain as inputs all assignments of evaluative or formative 
statements for individual test-takers based on their results on the test; and 

(b) with respect to that skill, calculate a number of times each evaluative or formative 
statement was assigned to individual test-takers in the group; and 

(c) with respect to that skill, assign to the group the evaluative or formative statement 
assigned to the greatest number of test-takers in the group. 

58. (Previously Presented) An article for choosing an instructional approach in a skill 
appropriate for a group of test-takers based on results of a test, the article comprising a computer- 
readable medium storing computer-executable instructions that, when applied to a computer system, 
cause the computer system to: 

(a) identify a set of potential instructional approaches in the skill; 

(b) estimate the utility of each identified instructional approach with respect to each 
individual test-taker, based on that test-taker's performance in the skill on the test; and 

(c) determine which of the potential instructional approaches in the skill maximizes an 
aggregated utility of all individual test-takers in the group. 
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59. (Previously Presented) An article for displaying test-takers' results on a test administered 
during the prior instructional timeframe, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

(a) obtain test-takers' skill-by-skill scores or evaluative or formative statements with respect 
to a test that (i) is administered during a given instructional timeframe and (ii) assesses a subject in 
which the class groupings of test-takers for purposes of instruction varies between that instructional 
timeframe and a next analogous instructional timeframe; 

(b) display skill-by-skill scores or evaluative or formative statements with respect to those 
test-takers, wherein displays of such test-takers are organized around class groupings of a next 
analogous instructional timeframe. 

60. (Previously Presented) An article for providing results of a group of test-takers with 
respect to multiple skills assessed on a test, the article comprising a computer-readable medium 
storing computer-executable instructions that, when applied to a computer system, cause the 
computer system to: 

display the results of the group of test-takers in multiple tested skills, such that a single screen 
on the display includes names of tested skills and corresponding scores or evaluative or formative 
statements reflecting the group's results in each skill; and 

enable a viewer, by using an electronic interface, to select a tested skill from the display and 
thereby view another display of the results of the group of test-takers in a single skill, 

display the results of the group of test-takers in the single skill together with a list of test- 
takers' names and a presentation of the scores or the evaluative or formative statements applying to 
each individual test-taker in the skill. 

61. (Previously Presented) The article according to claim 60 wherein the article includes 
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instructions to cause to be displayed, in response to the viewer's selection, a presentation of 
individual test-takers' names, shown in subgroups corresponding to the evaluative or formative 
statement appropriate to each subgroup. 

62. (Previously Presented) The article according to claim 60 wherein the article includes 
instructions to enable the viewer to select another tested skill using the electronic interface and 
thereby view a display of the results of the group of test-takers in a single skill together with a 
presentation of the scores or the evaluative or formative statements applying to each individual test- 
taker in that skill. 

63. (Previously Presented) An article for providing results of one or more test-takers with 
respect to multiple skills assessed on a test, together with skill-specific instructional materials 
appropriate to that group of test-takers, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

display the results of one or more test-takers in multiple tested skills, such that a single screen 
on the display includes names of tested skills and corresponding scores or evaluative or formative 
statements reflecting the test-takers' aggregate results in each skill; and 

enable a viewer to select a tested skill, by using an electronic interface, and thereby view 
instructional materials relevant to that skill. 

64. (Previously Presented) The article according to claim 63 wherein the instructional 
materials include instructional materials of a difficulty level appropriate to the test-takers based on 
their performance on the test. 

65. (Previously Presented) An article for providing results of one or more test-takers with 



Page 22 of 25 



Appl.No. 10/072,820 

Resp. dated February 16, 2005 

Supplemental Response 

respect to skills assessed on one or more multi-skill tests, enabling the administration of skill specific 
assessments, and displaying the results thereof, the article comprising a computer-readable medium 
storing computer-executable instructions that, when applied to a computer system, cause the 
computer system to: 

display the results of one or more test-takers in multiple tested skills on a single test, such 
that a single screen on the display includes names of the tested skills and, for each skill, 
corresponding scores or evaluative or formative statements reflecting the test-takers' aggregate 
results in that skill; 

select a tested skill and thereby view one or more assessments specific to that skill; 
enable a viewer to choose an assessment specific to the selected skill by using an electronic 
interface; 

enable the viewer, by using the electronic interface, to distribute, to one or more of the test- 
takers, the chosen assessment; 

enable the viewer, by using the electronic interface, to collect results of the chosen 
assessment specific to the selected skill, for one or more of the same test-takers; and 

enable the viewer, by using the electronic interface, to choose, from a single screen on the 
display, to view (i) displays of test-takers' results in a given skill based on one or more multi-skill 
tests or (ii) displays of test-takers' results on one or more assessments specific to the selected skill, 
wherein each of the displays includes a list of test-takers' names and a presentation of the scores or 
the evaluative or formative statements applying to each individual test-taker in that skill. 

66. (Previously Presented) An article for providing results of a group of test-takers with 
respect to multiple skills assessed on a test, the article comprising a computer-readable medium 
storing computer-executable instructions that, when applied to a computer system, cause the 
computer system to: 
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display overall results of the group of test-takers on the test, such that a single display 
includes multiple test-takers and corresponding overall scores in the test for each individual test- 
taker; 

enable a viewer, by using an electronic interface, to select an individual test-taker and thereby 
view a display of that test-taker's results in multiple tested skills; and 

in response to the viewer's selection, display an individual test-taker's results in multiple 
tested skills, wherein the display includes multiple tested skills with corresponding scores reflecting 
the test-taker's performance in each tested skill. 

67. (Previously Presented) The article according to claim 66 wherein the medium includes 
instructions to cause the computer system, in response to the viewer's selection, to display multiple 
tested skills with corresponding evaluative or formative statements reflecting the test-taker's 
performance in each of the tested skills. 
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